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1 Introduction 




(l.i) 



where G is a parametric set for this family and for each $ G © the sequence 
$^ = ($^) n>0 is a homogeneous Markov chain defined on some measurable 
space {X , B(X)) with a transition probability P tf . 

Our main goal is to study the geometric ergodicity property for this family 
uniformly over the parameter d G 0. 

The geometric ergodicity property is studied in a number of papers (see, 
for example, [12]- [33]) for the case of single Markov chain. An important con- 
tribution is given by Meyn and Tweedie. The principal Meyn-Tweedie result 
concerning the geometric ergodicity is the following one (see, for example, [12]). 

Let ($„)„>! be an ergodic homogeneous Markov chain on the space (X, B(X)) 
with an invariant measure n. If there exists R — > [l,oo[ function V(x) for 
which the chain ($ n ) n>1 satisfies the drift condition, then there exist some 
constants R > and k > such that, for any n > 1, 



This property is called geometric ergodicity. It is useful in applied problems 
related to identification of stochastic systems, described by stochastic pro- 
cesses with dependent values, in particular, governed by stochastic difference 
or stochastic differential equations. As we will see later (see, Definition 15.11 
below) the function V, providing the drift condition, is given by the Lyapunov 
functions (see 0) in the case of diffusion processes and (see [I], [7J, [S]) for 
Markov chains. For this reason, in the sequel, we will call such functions by 
Lyapunov functions. 

Necessity of the uniform geometric ergodicity appears in statistics, when 
one studies nonasymptotic risk and has to evaluate the maximum of expected 
losses over the family of distributions related to a statistical experiment. In 
particular, in this paper we will apply the geometric ergodicity property to 
the nonasymptotic nonparametric estimation problem (see pQ) for the ergodic 
diffusion process governed by the stochastic differential equation 



where S is a unknown function from some functional class, a(y) is supposed 
to be known. To construct an optimal estimator of S we need to apply the 
geometric ergodicity property to the homogeneous Markov process uniformly 
over S from some functional class (see f)2.4p below). Note that the function S 
is the family parameter in this case. 
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In order to explain the novelty of the introduced in the paper method, we 
give the scheme of proving the property (11. 2p in the case of a single chain. The 
first step consists in passing to splitting chains, which yields a chain with an 
atom. Then, one makes use of the Regenerative Decomposition for splitting 
chains to evaluate the convergence rate (see [6], [12] ). Let us remember that the 
principal term in this decomposition gives a deviation in the renewal theorem, 
which may be evaluated thanks to the Kendall renewal theorem that provides 
a geometric convergence rate. 

Unfortunately, in the case of a family of Markov chains this method is 
inapplicable because the Kendall renewal theorem does not provide the explicit 
constant in the upper bound. The Kendall theorem claims only the existence 
of some finite constant that depends, in our case, on the parameter and there 
is no method to make obvious this dependence on the family parameter. As 
consequence, the constant R will depend on the parameter $ as well. 

Therefore, the problem is to find a nonasymptotic exponential upper bound 
of type (II. 2p with explicit constants involved in. 

To that end in the paper we apply the coupling approach (see |1 Oj ) instead 
of the Kendall theorem. Note that in their book Meyn and Tweedie apply 
this approach for obtaining a polynomial convergence rate. We obtain an 
exponential convergence rate thanks to making use of Lyapunov functions for 
coupling renewal process which turn out to be independent of the parameter 
(see Theorem 13.11 in Section [3]). 

This upper bound enables us to find the explicit nonasymptotic exponential 
upper bound in the ergodic theorem for which we can find the supremum over 
all Markov processes family in (11.11) . 

In this paper we find some sufficient conditions which provide the geometric 
ergodicity for the homogeneous Markov chain family uniformly over this family. 
We check these conditions for the diffusion model (11.31) . 

The paper is organized as follows. In the next Section the main results are 
formulated. In Section [3] we give the coupling renewal methods. In Section H] 
the geometric ergodicity is proved for a family of homogeneous Markov chains. 
In Section [5] we apply this property to nonasymptotic nonparametric estima- 
tion in stochastic differential equations. In the Appendix some basic results 
are given on homogeneous Markov chains. 

2 Main results 

Assume that the transition probability family (P 1? )^ ge satisfies the properties 
H-J There exist X — > [l,oo) function V, some constants p, D, < p < 1, 
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D > 0, and a set C from B{X) such that 



V* = sup V(x) < oo 



and, for any x G X, 



supEf (V(^)) < (l-p)V(x) + Dl c (x). (2.1) 

H 2 ) There exist 5, < 5 < 1/2, some set C G B(X) and some probability 
measure v on B(X) with u{C) = 1 such that, for any x G X and any A G 
B(X), 

inf P°(x,A) > 2Sl r (x)u(A). (2.2) 
Here means the expectation with respect to the transition probability 

Remark 2.1. Condition H-J is called the uniform drift condition and that of 
H 2 ) is the uniform minorization condition. 

Theorem 2.1. Assume that the family (II. ip satisfies the conditions H 1 )-H 2 ) 
with same set C G B{X). 

Then, for each 6 6 0, the chain $^ admits an invariant distribution tt on 
B(X). Moreover, there exists k > such that 



sup e Kn sup sup sup 

n>0 i960 x£X l<f<V 



V(x) 



E* /(*«)- / f(z)A*z 



X 



< oo. (2.3) 



Apply now to the process (II. 3p . We assume that the function 5* belongs to 
the functional class S Mai introduced in [2], i.e. 

S Af,a,i = {S e B M a : inf > —L , sup < -1/L} 

\ x \> a \x\>a 

with 

B Mta = {S G C^R) : sup|S(x)|<M}, 

X'| <(! 

where M > 0, L > 1 and a > are some fixed real numbers. 

As concerning the diffusion coefficient, we suppose that o~(x) is twice con- 
tinuously differentiable and < er < a(x) < U\ < oo. 

Note that (see, for example, [3]), for any function S from T, MaL , the equa- 
tion ( II .3p admits a unique strong solution, which is an ergodic process with 
an invariant density tcs having the following form 

(l/a\x))ex P {2j Q x (S(v)/cr\v))dv} 



(l/<r»(z)) exp{2 jj {S{v)/a\v))dv}dz 
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Theorem 2.2. For any e > 0, there exist constants R = R(e) > and 
k = n(e) > such that 

supe-supsup sup \ E s(9(y t )\yo = *)--s(9)\ < fl> (JU) 
*>o llsll*<i xeu seT, U a L (l + x) e 

where 

\\g\\* = sup \g(x)\ . 

Remark 2.2. Note that the property (12. 4p is called geometric ergodicity. As 
is shown in Section^ the function (1 + x 2 ) e is the Lyapunov function. 



3 Coupling Renewal Methods 

In this Section we will obtain a nonasymptotic upper bound with explicit 
constants in the renewal theorem by making use of the coupling method. The 
used here notions can be found in (j5], [7], [TO]). 

Let (Xj)j>o an d (Yj)j>o ^ e two independent sequences of random variables 
taking values in N. Assume that the initial random variables Y and have 
distributions a = (a(k)) k>0 and b = (b(k)) k>0 , respectively, i.e. for any k > 0, 

P(F = k) = a(k) and P(F ' = k) = b(k) . 

The sequences (Xj)j>i anc ^ 0^j)j>i are su PP° se d to be the i.i.d. sequences with 
the same distribution p = (p(k)) k>0 , i.e. for any k > 0, 

P(Y 1 = k) = P(y; = k) = p(k) . 

We assume also that a(0) > and p(0) = P(Y 1 = 0) = 0, i.e. the sequences 
{Yj)j>i an d (Xj)j>i t & ke values in N* = N \ {0}. Moreover, we suppose that 
the distributions a, b and p satisfy the following conditions 

C-J For any k > 1, 

p(k)>0. 

C 2 ) There exists a real number r > such that 

In (Ee ry ° + Ee rY o +Ee r7 ') < v*{r) < oo . (3.1) 

For any n > 0, we define the following stopping times 

k 

t n = M{k>0 : ^F 4 >n}, 
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t' n = M{k > : Y l > n } 

i=0 

and we set 

t f 

n n 

W, = V Y", - n and W = V Y' - n . 

n / j 3 n / j 3 

3=0 3=0 

Further we introduce the sequence of stopping times (c k ) k>0 : 

a k = M{l>a k ^ + l : Wj = l},<7 = 0. 
Proposition 3.1. Assume that the conditions C x ) — C 2 ) hold. Then 

Ee m ' < 3e v * {r) . 

Proof. First of all, note that 

P(a 1 = l\W = l)=p(l) 

and, for k > 2, 

P(a 1 = l\W = k) = l {l=k _ 1} . 

Furthermore, 

P(W = k) = a(0)p(k) + a(k) . 
This implies that, for any I > 1, 

P( <7l =l) = a (0)p(l)p(l) + a(l)p(l) + a(0)p(l + 1) + a(l + 1) . 

Thus we calculate 

oo 

E e rCT i = P(W = 1) E e ry i + ^ E e^" 1 ) P(W = k) 

k=2 

< E e rY ^ + a(0)E e ryi + E e rY » . 

This implies the desired inequality, due to the condition C 2 ). 
□ 

Now, we introduce the embedded Markov chain (C k ) k>0 by 

and the corresponding entrance time 

zu = M{k > 1 : Z k = 1} . 
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In order to study the property of this stopping time, we need the following 
notations 



A*(r) 



1 2v*(r) ' 

3 e «*(r)+r/2 



1 - e~ r / 2 
Moreover, we set 



1 - e" r i 



and 



2 , / 2A*(r) 
In 



A*(r) 



v^p^+ (1 + A*(r))e r i 



r \ 1 — e r i 



(3.7) 



1. 



(3.8) 



Proposition 3.2. Assume that the conditions C x ) and C 2 ) ZioZd. T/ien 

Ee 7iro < A*Jr)e v * ir) , 



(3.9) 



w/iere 7 X = min^, tj, 7* = -- ln(l - />*) , 



rln(l - 



2(\nA*(r) +r 1 lj 



and 



A*(r)e Tl1 * 

^'• ): 4 i (;) ( L+ l-(l- l/4 



Proof. First of all, note that the sequence (W n ) n>0 is a homogeneous Markov 
chain taking values in N*, i.e. for any n, k and / from N* 

P(W n = k\W n _ x = l)= p(k)l {l=1} + l {k=l ^ 1} l {l > 2} ■ 
Hence, the sequence a k can be represented as 

k 



i=2 



(3.10) 



where (£j)j> 2 are i.i.d. random variables such that, for any I 6 N*, 
P^ 2 = l) = P(a 1 = l\W = l)=p(l). 
Therefore, the process (Z k ) defined in (13 .5p is a homogeneous Markov chain. 
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For any positive function V, one can calculate directly 

E [ViZjlZ, = /] = E V(l — a,) l {ai<l} + E V( Vl -a,+l) l K > /} 



where 



"1= E 

j=t' +1 

Choosing now V(x) = e TlX with r l defined in ( 13. 7p yields 

E[y(Zi)|Z = l \ _ E - ¥l i ir^Mi, , 

ym ~ 1 K</} + - Cje 1 W 1 >i}- 

Taking into account that t' < n + 1, we estimate the exponential moment for 
r/ 1 as 

oo 

e^ 1 " 1 Wo^E ( Eerin ) n+1 

By the Holder inequality (with p = r/r^, one has 

Ee r ^<e r/2 . 

Thus 

oo 

Ee?Vhl K>0 ^ E e r( " +1)/2 PK = n) . 



By making use of the upper bound from Proposition 13.11 we find 

P( ai = n) < 3e v * {r) e- rn . 

Therefore, for any I > 1, 

Ee^l w > < A*(r)e- rl /\ 

where A*(r) is defined in (13.71) . Moreover, taking into account the definition 
of in (13.71) . we obtain 

E\V(Z,)\Z n = I] „ l-e~ r i 

i.e. the chain (Z fc ) fc>1 satisfies the condition (IA.2I) in the Appendix with 
C = {!,-■ -J J and D = (l + A*(r))e r i / *. 
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Therefore, by using Proposition IA.2I with 7* defined in (13.71) . one gets 

S S no - 

where A*(r) is given in (|3.8p . Moreover, note that, for any I > 1, 

00 

P(Z, = l\Z = l)= Pfa = l-l) + J2 P(^i = J')P(^i = 1+3-1) 

3=1 

> PK = l)p(l) . 
Therefore, from (13.4)1 we estimate from below as 

P(Z 1 = l|Z = /)>a(0M/)p 2 (l), 

i.e. 

min P(^ = 1\Z = > a(0)p 2 (l)p mm (/J := ? , , 

where p min {k) = mm 1<l<k p(l). Now the condition C : ) implies the inequality 
(1A.51) for the set 5 = {1}. Then Proposition |A]3] implies directly the inequality 
<B>. □ 

Let us define the renewal sequence (u(n)) n>Q as follows 

00 

u(n)=£y'(n), (3.11) 
i=o 

where p*- 7 denotes the jth convolution power. We remind that for j = 0, we 
set p°(n) = 1 for n = and p°(n) = for n > 1. 

Proposition 3.3. Assume that the conditions C x ) and C 2 ) /ioW. Then, for 
any n > 2, 

\a * u(n) - b * u(n)\ < M* e~ Kn , (3.12) 
w/jere a * u(n) = a(j)u(n - j), 



/ 3A;(r)e w *MeTi/ 4 „ _ 

M*(r) = 1 —n and « - h 



e 7i/4 _ 1 . . 2t;*(r) 

Proof. Obviously, that for n > 1, 
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a * «(n) = P U J=0 ^ = n = P(^ n _ 1 = 1) 



i=0 



and 

b*u(n) = P ( U J=0 \J2 Y : = n \)= = !) 



i=0 



Thus, 

A(n) = a * u(ra) - 6 * u(ra) = P(W n _ 1 = 1 , > 2) 

-*(W^ 1 = l,W n _ 1 >2). 
Now, we introduce the "coupling" stopping time r as 

r = inf{fc>l : (W k , W' k ) = (1, 1)} . 
Note that, for any n > 2, by strong Markov property, one has 



71—1 



P(W B = 1 , < > 2, r < n - 1) = p (^n = 1 , ^ > 2, r = fc) 

fc=i 

71-1 

= ^P(r = A;)P 2 (^ fc = l|^ 



k=i 

Similarly, one gets 

n— 1 

P(lT = 1 , W B > 2, r < n - 1) = = ^)P 2 (^ fc = 1 1 W 

k=i 

Therefore, putting 

a 1 (n)=P(W n = l,W^>2,r>n) 

and 

a 2 (n)=P(W^ = l,W n >2,r>n) 
yields, for any n > 2, 

|A(ra)| = | ai (n-l)-a 2 (n-l)| 

< max — 1) , a 2 (n — 1)) < P(r > n) . 

Taking into account that t < a m a.s., we obtain 

|A(n)| < P(<7 ro > n) < e- Kri Ee KCT - . 

Note now that 

oo oo 

Ee KCT - = EeK<Tfe 1 {^=fe} ^ VEe 2 ^ ^P^ > fc). 
fc=i fc=i 
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Moreover, by Proposition 13.11 and by the Holder inequality, one has 

Ee KCTfe = Ee ro ' (Ee^»)" < 3e k ^ /2 . 
Now, the inequality (13. 9p implies the upper bound (I3.12p . □ 

Theorem 3.1. Assume that the distribution ofY 1 satisfies the condition C-J 
and, for some r > 0, 

Ee ry i < oo. 



Then, for any n > 2, 



u\n) 



EY 1 



< M*(r)e 



(3.13) 



(3.14) 



where the coefficient M*(r) is given in (13. 12ft with 



v*(r) = In 1 + 



Ee ry i 



(3.15) 



Proof. We choose the distribution a(0) = 1, i.e. Y = a.s. and 

^ oo 



i=j+l 



It is easy to see directly that, for any j > 1, 



b * u(j) 



Moreover, 



EY 1 



j'-i 



j=l 1 j=l i=0 



i.e. the distributions a, 6 and p satisfy the condition C 2 ) with v*(r) given by 
dSH]). 

□ 



4 Proof of Theorem 12.11 

First of all note that, the condition H 1 ) and Proposition IA.2I with 



r = ~2 ln ^ ~ p ) 
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imply immediately that 



„ M U»(x,r,V) 
L>i\r) = sup sup 



V(x) 



< oo . 



(4.1) 



where 



U*(x, r, V) = E^J2 &ri V (®j) and T c = inf i n > 1 : $ n e C) • 
i=l 

Now, we introduce a splitting chain family as in [12], p. 108 (see also [13]). 
We set A? = <Y x {0, 1}, X = X x {0} and Af x = X x {1}. Let B{X t ) be the 
a— fields generated by the set A t = Ax {i} with A G B(X),i = 0, 1. Further we 
define the a— field B(X) as a cr— field generated by B(Af Q ) U B(X l ). Moreover, 
for any measure A on B(X) we relate the measure A* on B(X) as 



A* (A)) 



8)X(AnC) + \(Anc c ) 



and 



X*(A l ) = 5X(A n C) . 

Now, for each $ G 0, we define a homogeneous Markov chain ($^) n > by the 
following transition probabilities P (x, •) = Q (x, •)* with 

P»{x,-), if xeX \C - 

if iGC ; (4.2) 
if x E X l . 



<?*(*,■)=< 



P tf (a:,-)-H; 



Obviously, that the set a = C x is an accessible atom for the chain ($ ) n>1 , i.e. 
for any positive <Y — >■ R function g 

E^(6J) = Ej^), for any x,yEa. 

Moreover, the chain ($ ) n>1 is z/*— irreducible, thus -^—irreducible. Indeed, let 
z/*T > for some set T. Then one can see directly that, for any x G X x U C , 



P(z,f) > 



Moreover, for £ G Af \ C , 



P 2 (x 0) r)= / P(x } dz)-p(z,T)>-p*(x J X l )P(z,T)>5v*(T). 
J x 
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This implies directly that, for any nonnegative random variable £ measur- 
able with respect to the a— field generated by the chain ($ ) n>1 , one has 

tf £ = E tf £ for any x, y e a. 

x y 

In the sequel denote by E (•) the such expectations. 
For any set C from B(X), we denote 

f c = mi{n> 1 : ^ n E C} . (4.3) 

Now, we define the X — >■ [1, oo) function as 

V-(i) = V(<x> 1 ), (4.4) 

where < x > x is the first component of i: G X which belongs to X. We set 

i=i 

By Proposition IA.6I we obtain that, for any x G X, 

U*(x,r, V) = (1 - 5)U» oUOi (x ,r, V) l {xeC} + U^ uCi (x ,r, V) l {x£CC} 

+ ^ uc 1 ( x i' r ' ^) 1 {xec}> 

where x i = (x,i) for i — 0, 1. Taking into account that, for any x, from A' 
and any set C from B(X), 

we obtain from (14. ip 

U» uC (x,r,V) „ 

sup sup — 9 — ^ < X?(r) < oo , 

fee x & x V(x) 

where 

Note now that, for x G C Q by the definition (14.21) and the condition H 2 ), 



1-5 ~ 1-5 
Similarly, for x G C 1 , 

P*(£, a) = P*(sc, = 5v{C) = 5 . 
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Hence, taking into account that < 5 < 1/2, one gets 



5 2 

inf inf P*(ac,a) > -. (4.6) 

£GC UC 1 i?£9 1 — 



Thus, by Proposition \AA\ one obtains that 



U*(x,r, V) 

V 2 (r) = sup sup a , < oo . (4.7) 



Therefore, by Proposition IA. lj. the chain ($„) n >o is ergodic for each § G @ 
with the invariant measure given as 



1 

7f*(f ) = E^Y, 1 {4f6f} , where ^ = ^ . (4.8) 

3= 

Now, for any n > 1, we define 



j=l a 



t* = max{l < j <n - 1 : $^ G «} 

and we put t* = if f a > n. Moreover, note that, for any X — > R function / 
and any n > 2, 

n-l 

i=i 

n-l 

=E^i,«,^ (/(*» w*r *;)■ 

Note that, for j < n — 2, 

{ l '=i} = {i;ea,i; 1 ^ ) ... ) i;ja} 



and 



K = n-l} = {$tie«} 



Now, taking into account that ($ 1? ) ri>l is a homogeneous Markov chain, we 
can calculate the last conditional expectation as follows 
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where, for k > 1, 



/to i {fa >* } . (4.9) 

By convention, we set t^(0) = 0. Therefore, 



n 



where u^O) = and, for j > 1, 
Moreover, for j > 1, 



z=i 

j 



i=i 

where 

7*,*(0 = P " ( f * = u,(l) = PI (If G «) . (4.10) 

It is clear that 7 £ $(0) = 0, i.e. 7^$ * %(0) = 0. This implies that 

for all j > 0. Finally, for any n > 2, 

Ej l {fa<n} = 7M * % * f /j# (n) . (4.11) 

Note that the sequence (w#(^)) n >o is a renewal sequence, i.e. 

oo 

M n ) = E ^( n )> 

i=0 

where p^(fc) = P^O^ = k). Now, we set 

A M = \u#{n)-^\ . 



We estimate this term by Theorem 13.11 First we have to check the condition 
C x ) uniformly over the parameter $ e G, i.e. to show that, for any > 1, 



inf min P tf (f„ = j) > . (4.12) 
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Let us check this property for k = 1. We remind that, by the condition H 2 ), 
one has v{C) = 1. Thus, the definition (14.21) implies 

P* a {f a = l) = S{C l ) = 6>0. 

Moreover, for z G C , i.e. z = (z, 0) with z G C, one has 

p#(z, C ) = P*(z, C) - 5v{C) > 5u{C) = 5 . 

By induction, one can show that, for any j > 1, 

(& 1 eC ,...,$ j €C Q )>(l-S)Si- 1 . 

Therefore, taking into account (14.61) yields, for j > 2, 

K( f a =j)=K ('I', vn ,f n.<I. ; C n) 

>Pl (<i v c - c 0l &< ('.) 



6Pj (MC.,-,Vi gg o) > p-i 



> 

1-5 

Hence, by Theorem 13.11 there exists a constant k, < k < r/2 such that 

A* = sup e 2Kn sup A 1? (n) < oo . (4.13) 

Moreover, noting that 

**(/) = E f fAi) > 

i=o 

and that < 1 one obtains, for any n > 2, 

|flj/(^)l {fa<n} -#*(/)] < T 4 ,**A„*t /i1 ,(n)+g M *t />1 ,(n) + s />tf (n) > 
where 

= ( r a > and S /,<?M = Yl tfAfi ■ 

j=n+l 

Therefore, for any n > 2, 

|E* - **(/)| < 7m * A, * + g M * 

Note now, that from (14.71) we obtain, for n > 2 and for any function 1 < / < V, 
e rn Mf{¥)l {fa > n} < U»(x,r,V)<V 2 (r)V(x). 
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Similarly, 

e rn s M (n) < U»(a,r,V) < V 2 (r)V* < V 2 (r)V*V(x) . 

Putting 

g (x^) = J2e Kn \Kf(K) -**(/)! ( 4 -!5) 

n>2 

yields 
where 



and 



,,. ") 

n>0 n>0 ra>0 



VJr) = 2-^ . 

a\ / e r/2 _ I 

Now, one obtains the following estimates 

7 M = < C^(i, r, V) < V 2 (r)V(x) . 

Similarly, 

fc,, < 1 + r, V) < (1 + P 2 (r))y(x) . 

The inequality f |4.13|) implies 

A tf < A* . 

* e K - 1 

Thus, 

£ = sup sup - < oo . 
xex flee V(i) 

Note that the chain ($ n ) n>1 is ergodic with the invariant measure defined 
in ( 14. 8 p and ( 1A. 14j) . By applying Proposition IA.6I with A equals to the Dirac 
measure of x, we obtain that, for any function < / < V, 

Ej/O&J - **(/) = (1-5) (e; /(*J - **(/)) l {x . ec} 

+ (</(iJ-*'(/)) W>, 

where /(x) = /(< i > 1 ). Thus, for any x G X, one gets 

|e;/(*j - Af)\ < \K /(*») - **(/)! + MJ - Af)\ ■ 
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Taking into account that, for any x G X, 

V(x) = V(x) = V(x ) = V( Xl ) 

yields the inequality 

^er»\J%f($ n )-**(J)\<2 e *V(x). 

n>2 

Using here the condition H 1 ) we obtain, for any X — > R function < / < V, 
|Ef/($J - tt*(/)| < (1 + e K (l + D) + 2o*) V{x) . 

n>0 

□ 

5 Application to diffusion processes 

In order to study the geometric ergodicity for the process (11.31) we start with 
the chain ($^) n > , where <E>^ = y n . 

Proposition 5.1. For any S G S M aL , the sequence ($^) n>0 is a homogeneous 
Markov chain aperiodic and ip -irreducible, where ip is the Lebesgue measure on 
B(M). 

Proof. Taking into account (see, for example, [3]) that the solution of the 
equation (jl.3p is a homogeneous Markov process, we obtain immediately that 
(&n)n>o * s a homogeneous Markov chain. In this case (see [3]), the transition 
density of the process (y t ) has the following form : 

/ | \ / , \ G{t, x, y) f m §(u)du- (/fa)-/(-)) a 

p s(Vt = VIVO = x) =g(t,x,y) = e J t^ 2t , (5.1) 

V27rta(y) 

where 

i r* ~ 

G(t,x,y) = E 5 exp{-- / B(S)(w u )du} , B(S)(x) = S(x) + S 2 (x), 

* Jo 

~, . S(g(z)) l. . N f x du 



<t((/(z)) 2 ' y <r(u) ' 

w« = /(a) + -r(f(y) - f(x)) + w u - -w t , 

g(z) is the inverse function of /, i.e. g(z) is the solution of the equation 
z = Jq ^jy. The solution exists since a does not change the sign. 
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This means that, for any n > 1, for any A G B(JH) and for any x G R, 

P s ($^ G A\$l = x ) = g(n,x,z)dz. (5.2) 

J A 

Thus, the chain ($^) n>0 is ?/>-irreducible, where ip is the Lebesgue measure on 
S(R). Moreover, in this case the chain is aperiodic, i.e. d = 1. 
□ 

Now, we check the minorization condition H 2 ) for the chain ($^) n>0 - 

Proposition 5.2. For any K > 0, the chain ($^)„>o satisfies the minorization 
condition with C = [-f(K), f(K)] uniformly over S , i.e. for any K > 0, there 
exist 5 = 5 K > and some probability measure v K on B(M) with v K {C) = 1 
such that, for any set A G B(JBL), 

inf inf P 5 ($f G A\$ y = x) > 8v K {A) . (5.3) 
x£U se~s M a L 

Proof. From (15. 2p it follows that 

P 5 ($? G A\$l = x)= [ g(l,x,z)dz. 

J A 

Now, setting v 1K = P 5 (max 0<u<1 \w u \ < K) and 

V 2K = SU P SU P I |B(5') (2;) I + 2 / |iS(u)|dit J , 

one finds that, for x G C and y G C, 

9{l,x,y) > e-f 2 ^" :=^f g K (v) 

V 2irai V 2-kcti 

with 

g K (y) = -^-e~^l {y&c} and = 2 [ e-™dt. 

V 3,K Jc 

This implies the inequality (15. 3p with 

^= ' /k- and u k( a ) = / eAy) d y- 

y 2,Ti a 1 J A 



□ 



Definition 5.1. A R — > [1, 00) function V is called uniform over S Lyapunov 
function for the equation (II. 3p if it is twice continuously differentiable and such 
that, for some constants 7 > and f3 > and for any 16K, 



cr 2 (x) 



sup ( V(x)S(x) + —±-LV(x) ) < -~fV(x) + /3 . (5.4) 
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Moreover, lim^oo V(x) = oo and there exists m > such that 

sup TTbF K 00 • (5 ' 5) 

zGR ' I I 

Remark 5.1. For any c > and < e < 1 ; i/ie function 

V(x) = (1 + x 2 ) e (5.6) 
satisfies the inequality (15.41) mtt 7 = e/(2L) and 

/ • a- 2 fx) •■ 

(3 = sup V(z)(M + Lx*) + — + 7 y(a; 

where x* > a. Indeed, one has 

S(x) S(x) 3(6)(x-a) M 1 La 1 
xx x x L x 2L 

provided \x\ > a* = 2L(M + aL). Therefore 

V(x)S{x) + —^-V(x) = 

2eV(x)^—,^l + eV{x)^% + 2e(e - l)V(x) 



1 + X 2 X 1 + X 2 (1 + x 2 ) 2 



provided (L' 1 + a 2 ) / (1 + x 2 ) < 1/(2L), i.e. \x\ > y/l + 2La\. 
Choosing x* = max[2L(M + aL) , a/1 + 2Laj] yields 

a 2 (x) ■■ 

sup svp[V(x)S(x) + —^- L V{x) + jV(x)} </3. 



Proposition 5.3. Assume that 



\ S ( X )\ 



and there exists a Lyapunov function for the equation M.3\) . Then the chain 
{<&n)n>o satisfies the drift condition uniformly over S , i.e. there exist constants 
K > 0, D = D K > and < p = p K < 1 such that, for any xel, one has 

sup B s (V(S?)|* = x) < (1 - p)V{x) + Dl {lxl < K} . (5.8) 

■3 65] A ,r _ r 
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Proof. By the Ito formula, one gets 

V(y t ) = V(y ) + £ (v(y s )S(y s ) + °^-V{y s )\ ds + jf V(y,)a(y,)dw a . 

In Proposition 4.1 from p], we have proved that the moments of the solution 
of equation (jl.3p are bounded, when cr(x) = 1, i.e. for any d > 0, 

sup sup sup E s (|y t | d |y = x) < c*{d + l) d/2 g d , (5.9) 

t>0 H<Jf S&T: M a L 

where c* and g = g K are some positive constants independent of d. The same 
kind bounds are true when < a < cr(x) < <j\ < oo. This implies that the 
stochastic integral is a martingale in the above Ito formula. 
Therefore, by setting 

g(t) = E s (V(y t )\y = x) 

one has 

9(t) = jf E 5 (v(y u )S(y u ) + ^-V(y u )\y = x^jdu . 
This relationship and the definition 15.11 give 

git) < - ig (t) + f3. 

By the Gronwall inequality, it follows 

g{t)<g{0)e-* + 0/>y. 

This implies 

sup E 5 (V(^)| 2/o = x) < V(x)e"y + fS/j. 

It is clear now that there exists K > for which the inequality f 1 5 . 8 j) holds 
with p = 1 - e" 7/2 and D = /?/7- 
□ 

5.1 Proof of Theorem 

For any t > 1 and any IR — >]0, 1] function g, we set 

= E s [g{y t )\y [t] = xj = E s (g(y {t} )\y Q = xj . 

Moreover, taking into account that 7r(g) = 7i(g), one has 

Vs(9(y t )\y = x )~ *(g) = E 5 (g(®( t] )\y = xj - n(g) . 

Therefore by applying Theorem 12.11 to the chain ($^) n>0 , we come the upper 
bound (12. 4p . Hence Theorem 12.21 □ 
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A Appendix 

A.l Homogeneous Markov chains with atoms 

We follow the Meyn-Tweedie approach (see [12] ). We remind some definitions 
from [T2] for a homogeneous Markov chains ($n) ra >o defined on a measurable 
state space (X,B(X)). Denote by P(x, -),x G X, the transition probability 
of this chain, i.e. for any A G B(X),x € X, 

P{x,A) = P x (® 1 G A) = P($! G A\% = x) . 

Therefore, the nth convolution power of this distribution is 

P n (x,A) = P rE ($„, G A) . 

We remind that a measure n on B(X)) is called invariant for this chain if, for 
any A G B(X), 

Z (A) = [ P(x,A)n(dx) . 

If there exists an invariant positive measure 7r with tt(X) = 1 then the 
chain is called positive. 

Definition A.l. The chain ($ n ) n >o ^ s ^-irreducible if there exists a nontrivial 
measure ip on B(X) such that, whenever <p(A) > 0, one has 

L(x,A) = P x (U^ 1 {$ n G A}) > for any x G X . 

One can show that, for any yj-irreducible chain, there exists a "maximal" 
irreducible measure which is noted as ip and the chain is called ip- irreducible. 
An irreducible measure ip is maximal if and only if ip(A) = implies 

ip{x G M. : L(x, A) > 0) = 0. 

In the sequel, we denote 

B + (X) = {A G B{X) : ip(A) > 0} . 

Definition A. 2. The chain ($ n ) n>0 is Harris recurrent if it is ip -irreducible 
and, for any A G B + (X), one has 

(it, 1 {*nGA} j = 1 > for any x E A. 
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Definition A. 3. The Markov ip -irreducible chain ($„) n>0 is called periodic of 
period d if there exist disjoint sets r 1; . . . , Y d in B(X) with 

V> (nj =1 rj) = o 

such that, for 1 < i < d — 1 and for any x G Ti, one has 

p x ($i e r m ) = i 

and for x G one /ias P ;c ($i G I\) = 1. T/ie c/iam aperiodic if d = 1. 

Definition A. 4. We m// say i/iat #ie c/jain ($n)„>o satisfies the minorization 
condition if, for some 5 > 0, some set C G B(X) and some probability 
measure v with u{C) = 1, one has 

P(x,A) > 25l c (x)v(A), A G B{X) and x G X . (A.l) 

Obviously, that the minorization condition implies that the chain is v - 
irreducible, therefore ip- irreducible. 

Definition A. 5. A set a G B + (X) is called accessible atom if, for any x and 

y from a, 

p(*,r) = p(i/,r), v r g B(x) . 

In order to study the ergodicity property, we associate to any set C G B(X) 
the stopping time 

t c = ini{k > 1 : $ fc G C} . 

Proposition A.l. Suppose that the Markov chain <£> is ip- irreducible and 
contains an accessible atom a such that 

E a r a < oo . 

Then the chain is ergodic with the invariant probability measure 7r defined as 

ff ( r )^E a gl {¥r} . 

3=1 

Proof. Indeed, by the definition of n, for any set T G B(X), one has 

f *(dz) P(z, T) = ^ E a jr 1 -< Tq} E a (l { ^ +ier} \^, • • • , *,) 



3=2 
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Moreover, it is easy to see that 

p Q ($ Ttt+1 g r) = p q (*! g r) . 

This implies the relationship 

/ 7r(dz)P(z,r) = 7r(r), 

i.e. the measure ir is invariant. Obviously, that ir(X) = 1, i.e. 7r is a probability 
measure. □ 

A.2 Lyapunov functions method for Markov chains 

We start with the definition of a "Lyapunov function". 

Definition A. 6. We will say that the chain ($„,) n>0 satisfies the drift con- 
dition if there exists Af — >- [1, oo) function V such that for some constants p, 
< p < 1, D > and a small set C from B(X) one has 

V x < (1 - P)V(x) + Dl c (x) (A.2) 

for all x G X . In this case the function V is called the Lyapunov function. 

We remind that E^, denotes the expectation with respect to the measure 

p«(0- 

Now, for any X — y [1, +oo) function / and any set A G B(X), we set 

U A (x,r,f) = E x Y,e r >f(<S> J ). (A.3) 

Proposition A.2. Assume that for the Markov chain ($ n ) n >i the condition 
(1A.2j) holds. Then, for any r, < r < — ln(l — p), one has 

sup U c (xr ,V) < Di{rh {AA) 
xex v \ x ) 

where 

(l . p)r + De r 

lV ; 1 - (1 - p)e r 
Proof. The condition flA.2j) implies immediately 

U c (x, r, V) < (1 - p)e r V(x) + (1 - p)e r U c (x, r, V) + D e r . 
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Taking into account that V(x) > 1, we obtain the inequality ( 1A.4j) . □ 

Further, for any set C from B(X), we introduce the sequence of stopping 
times (Tc*( n ))n>o as follows : r c (0) = and, for n > 1, 

r c (n) = inf {A; > r c (n - 1) + 1 : $ fc G C} . 

Obviously, that r c (l) = r c . We use the following property. 

Proposition A. 3. Let C and B be two sets from B(X) such that 

inf P(x,B) > 0. (A.5) 

xec 



Then, for any n > 1, 



sup P x (r c (n) < r B ) < (1 - O 

x&X 



n-1 



Proof. First, note that, for any x G C, 

P x (T C < T B ) < P x (1< T B ) = 1 - P(X, £) < 1 - ^ . 

Indeed, using the strong Markov property and denoting 

Z n — ^r c {n) l{r c (n)<oo} ) (A-6) 

one gets, for n > 2 and for any 



P x (W) < T s) = E x \}{T {n-l)<T B }¥ z n _S T C < T B, 

< (1 - OP a (t c (ti - 1) < r B ) . 

Obviously, that for n = 2, 

supP, (r c (2) <r B ) < 1 - . 

Therefore, by induction method, we obtain the desired inequality. 
□ 

Proposition A. 4. Assume that there exist a set C G B(X), a real r > and 
a R — > [1, +oo) function V such that 

D*(r) = 1 + sup -J- f/ c (x, r, V) < oo (A.7) 

xeA" v \ x ) 

and 

V* = sup V(x) < oo . (A.8) 

x£C 
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Then, for any set B G B(X) satisfying the condition OA. 5p . one has 

sup -±-U B {x,i,V) <£>*, (A.9) 

x&X V \ x ) 

where 

/ \ r ln(l - O 

7 = mm(r, t ) , t = - 



2 ln(£>*(r)V*) 

and 



C ; (r ) = c »( 1 + T ^g_ ) 



Proof. Indeed, note that 

oo r c (n+l) 

1^,7,10 = j>. $3 erfvcay i {rB >, } 

n=0 j=r c (n)+l 



< U C (X, "f,V) + J2 E, l {Tfl > ro (n)} e7TG(n) Uc(*n> 7, V) 



n=l 



where z n is defined in (1A.6j) . Taking into account that < 7 < r and the 
conditions ( ]A.7j) and (1A.8[) . we get 

sup C/ c (x,7,F) < D*(r) V*. 

x&C 

Therefore, setting 

T(x) = ^E x l {rs>rc(n)} e^W, (A.10) 

n=l 

we obtain 

U B (x, 7, V) < D*(r) V{x) + D*(r)^*T(x) . 
By the strong Markov property, we find, for any 7 > 0, 

E x e^W = E x e ^c("-i) E ^ ^ e ^ c < p ^ ^ e 7r (»-i) 

with 

p( 7 ) = sup E z e^o. 

zee 

By the induction method, we obtain 

E x e 7 ^ (n) <p"- 1 ( 7 )E :c e^ 
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and, for < a < r, it follows that 

Exe ar c (n) < V (x) D* (r) p" 1 - 1 (a) . 
From here by the Cauchy - Schwartz inequality, we give 



E x l {TB>Tc(n)} e^c(n) < ^/ Px (r B >r c (n))^E x e^c(n) 

< D*(r)V(x)q n - 1 , 

where 

q = q(K) = y/(l-^)p(2K). 
By the Holder inequality and the definition of k, we obtain 

p(2/ ^ )<( J D*(r)n 2K/r <^A^:, 

^)<(l-o 1/4 - 

This implies the inequality (1A.9|) . Hence, the Proposition IA.4I □ 
A. 3 Properties of splitting chains 

Now, we study some property of the splitting chain {& d ) n>1 constructed in 
Section 4 , which we represent as 

^=(<Ly, (a.ii) 

where 4> n G X and l n G {0, 1}. 

Proposition A. 5. For any measure A on B(X) and any set V G B(X), 

I P(x,f)A*(dx) = A*(f), (A.12) 



where 



X 1 (-)= [ P(x,-)A(dx). 
J x 



Proof. Indeed, by the definition of the * operation and of the transition 
probability P(-, •) we obtain 

/ P(x,f) A*(dx) = / P(x,f)*A(dx) = A*(f). 
J x J X 

□ 
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Proposition A. 6. For any n > 1, any measurable positive X n — > R junction 
G and for any measure A on B(X), one has 

! E x G„($ 1 ,...,$JA(dx) = /' K (: ,Xo { o„)A-(,l.r). (A.13) 

Proof. It is clear, that it suffices to check this equality for positive functions 
of the form 

n 

G n {x x ,...,x n ) = Yl 9j{Xj)- 
j=i 

First, we check this equality for n = 1. Note that, for any X — > M. function g 
and for any x G X, one has 

/ g(<y > l )P*(x,dy) = / g(y)P(x,dy), 
J x J x 

where <y> x denotes the first component of the y £ X = X x {0, 1}. Making 
use of this equality implies easy flA.13j) for n = 1. Assume now that the 
equality flA.131) is true until n — 1. We check it for n. Indeed, we have 

n 

E*G n (&, ....o„) 9j ( Xj ) = E* gSi) T@*) , 

3=1 

where 

n-l 
3=1 

Now, we set 



r 



where the measure A 1 (-) is defined in flA.121) . Therefore, taking into account 
Proposition IA.5I , we can represent the integral on the right hand side of the 
equality flA.131) as 



EjG n (0 1 ,...,0 n )A*(d£)= / T(y)ii*(dy) . 

J x 

By the induction assumption, one has 
/ T(y)fi*(dy)= / E, J] g j+1 (^) ^(dy) = / E x . G n (* lt . . . , $J X(dx) 

J X J X - =1 "A" 

Hence, the Proposition IA.61 □ 
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Proposition A. 7. Assume that the splitting chain ($ ) n >j /ias an invariant 
probability measure fc. Then, the chain ($„) n>1 has the invariant probability 
measure it on B(X) which is given as 

7r(r) = 7r(r ) + 7r(r 1 ). (A.i4) 

Moreover, tt = 7r*. 

Proof. Define the measure tt(-) on B(X) as follows 

7T(-)= / 7f(dl)Q(l,-)> 

where the kernel Q{-,-) is defined in (I4.2p . It is clear, that tt(-) is a probability 
measure on B(X) such that, for T G jB(Af), 

7r(f)= [ 7r(di)P(i,f) = 7r(f)*. 

Thus, 7r(r) = tt(T ) + niT-^ for any set T from B(X). Moreover, 

7r(r)= f fc(dz)Q(z,T) = [ n*{dz)Q{z,T) 
J x J X 

= (1-5)/" n(dz)Q(z ,T) + I 7r(dz)Q(z ,T) 
J c J c c 

+ 5 [ Tt{dz)Q(z 1 ,T). 
Jc 

Taking into account the definition (14. 2 p we obtain 

7r(r)= / P(z,r)7r(dz), 

J X 

i.e. 7r is the invariant measure for the chain ($ n ) n>1 - Hence Proposition IA.7I 
□ 
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